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ABSTRACT 


This thesis uses statistical analysis methods and 
Subjective decisions to determine the parameters necessary 
to establish crew selection criteria for the AH=-64 attack 
helicopter. The purpose of establishing these parameters is 


to ald the Army in establishing pilot selection criteria for 


the AH-64. 

The techniques of simple linear regression and 
nonparametric statistics indicated that the greater the 
experience level the better performance level achieved. The 
analysis of crews determined that less experienced crews 
performed proportionately as well as the more experienced 
crews. Curiously, the amount of experience of the pilot is 
not a determining factor, whereas the copilot gunners exper- 
ience is directly related to how well the crew performed. 
Crew selection for the AH-64 helicopter should be made from 
the existing AH-1 serieS community of aviators with the more 


experienced aviators performing duties as copilot gunner. 
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fe Nene DUG . ON 


The Army conductS operational tests on equipment to 
determine the feasibility of a new system. rPeasipal uty is 
determined during the Demonstration and Validation of 
alternatives phase of a systems development. OV sw are 
conducted to test the operational suitability, military 
utility, and operational effectiveness of the system. OT I 
tests are to determine potential operational suitability 
and effectiveness and OT lI tests demonstrate operational 
Suitability, military utility, and operational effective- 
ness leading to the production decision. 

To adequately test the new system in an operational 
environment a tactical unit is tasked to put the new system 
whnouga a rigorous tactically oriented test. This method 
enables the Army to evaluate the tactical employment 
feasibility and whether an active duty unit can operate, 
maintain, and employ the new system in a tactical 
environment. 

The unit chosen to participate in the operational test 
is supposed to be a typical Army unit. ties tanee Of 
experience and expertise should mirror the current level of 
Seetmenie in the Army. In this way, if the new system is 
purchased and deployed, no special criteria will have to be 


established to field the new system. 





The Advanced Attack Helicopter Test (AAH) design was in 
accordance with the above doctrine. D Company, 7th Combat 
Aviation Battalion was the tactical unit chosen to partici- 
pate in the test. The unit was required to fly and 
maintain the AH-64 for a period of 90 days in a tactical 
environment. Fort Hunter-Liggett was selected as the test 
site; it is Situated in the mountainous coastal region of 
mradie California and offers a myriad of terrain which 
closely approximates Western Europe. D Company conducted 
all operations in a field environment under the control of 
its chain of command. Test requirements were passed 
through the chain of command to add realism to the scenario 
ame te Maintain tactical integrity of the unit. This was 


the environment in which the AAH test was conducted. 


ae) ROE O'S E 

This thesis measures subjective versus objective 
decisions involved in the pilot selection for the AH-64 
operational test. It is intended to provide a method of 
selection of pilots for the AH-64 using other than 
statistical inference as a measure of experience. 

Experience is measured in many different ways; 
maturity, common sense, adaptability, and expertise. It is 
essential that all these elements be weighed so the 
selection process provides the most qualified individuals. 


The initial selection process for the Advance Attack 





Helicopter Test was in accordance with the operational test 
plan and current Army regulations. The selection, however, 
WaS overturned by TRADOC and the Program Manager. These 
agencies wanted a minimum flight hour requirement placed on 
those pilots selected to fly the AH-64. The participating 
Mec, did not have sufficient pilots to cover the flight 
hour requirement; thus, pilots from outside the unit had to 
be brought in to supplement the unit. The pilots chosen 
were supposed to mirror the experience level of Army 
aviators; however, the hourly requirement restriction put 
the AH=-64 pilots in an arena by themselves. These pilots 
far exceeded the experience of the normal Army aviators, 
and in fact, were more closely associated with the more 
experienced instructor pilot population. The difference 
between the AH-64 population and the normal population will 
be measured to show that flight hours are not the only 
means of measuring an individual's quality and performance 
level; rather, a subjective measure of his ability to adapt 


to a new environment is equally important. 





Die LOL ese LECLION PROCESS FOR THE AAH TEST 


Pilot selection for the Advanced Attack Helicopter Test 
began in August 1980. D Company was chosen as the opera- 
onal Unit to conduct the test. The commander was 
notified of the test requirements and tasked to provide 
BiLOups CO Participate in the test. 

The test required 14 pilots in seven two man crews. 
Six crews would participate in the test with the seventh 
crew being an alternate. Each crew would fly tne AH-1S 
helicopter and the new helicopter, the AH-64. A prot 
would occupy either the front (copilot/gunner) or the back 
(pilot) seat throughout the test. A crew member would not 
interchange pilot stations. The AH-1S helicopter, which is 
the most advanced attack helicopter in the Army today, 
would be used aS a baSe line helicopter to measure the 
combat effectiveness of the AH-64. Having the same crews 
flying both helicopters eliminated crew proficiency and 
experience as a testing parameter. The process allowed the 
test evaluators to hold crew proficiency constant and 
measure just the level of performance of the helicopters. 

The crews were selected from a universe of 20 AH-15S 
SELOUS . Three pilots within the universe were eliminated 


because of their duty positions; the commander, executive 


ee 











officer, and operations officer. These individuals! duty 
Pooamt2ons required their full attention, thus their 
Participation in the test would be limited to those 
Operational requirements implied by their position. 

The commander and operations officer selected the 14 
pilots from the remaining universe. They selected crews 
based on experience, ability, adaptability, combat sense, 
and maturity. They then selected crew members whicn 
complemented each other; pairing strengths and weaknesses 
in order to provide a typical attack helicopter crews. 

The first pilot selection went forward on 15 September 
1981 to the Operational Test and Evaluation Agency (OTEA) 
hOorwapproval . OTEA, the component agency responsible for 
evaluating the test results, worked in conjunction with the 
Training and Doctrine Command (TRADOC) and the AAH Project 
Manager (PM). These Ap eneeaE evaluated the pilot selection 
Submitted by the unit. The PM felt the crews did not have 
sufficient flight hours to handle the new helicopter and 
convinced OTEA and TRADOC to place a minimum hourly 
requirement of 1000 total flight hours and 500 AH-1 hours. 
Additionally, pressure from the Aviation Safety Center and 
the PM was placed on OTEA to change the single crew concept 
to dedicated AH=-1S and AH-64 crews. The PM and Aviation 
Safety Center felt the crews could not adequately handle 
both helicopters and associated systems within operational 


Savery constraints. 
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The new pilot requirements were sent to the unit on 1 
October 1980. The commander was required to increase the 
total pilot universe from which he could draw, to accom- 
modate the new requirement of 12 AH-1S and 12 AH-64 pilots. 
This was accomplished by adding 4 pilots from other units. 


Sieeene 24 pilots available, only nine met the hourly 


requirements. The commander, operations officer and 
battalion S-3 comprised three of the nine pilots. Because 
of their operational duties they were not considered. The 


commander decided to include the remaining six qualified 
pllots, and six additional pilots who he felt were totally 
capable of performing the mission with the same level of 
Sexipertmse as the guabified pilots. 

A meeting was scheduled on 8 October 1980 to discuss 
the pilot selection and test design. Pilot selection was 
Gee Imeawior topic of discussion. Mies unio Ss Gpllot List was 
Submitted for approval to TRADOC. Each pilot was discussed 
individually, using a performance profile designed by the 
unit commander. The list and profile were sent to OTEA and 
the PM for final approval. Both organizations rejected 
eee ot the pilots because of their flight hour 
deficiencies. 

The commissioned officer platoon leader, whom the 
commander felt was an absolute necessity, was not approved. 


The commander felt that a commissioned aviator platoon 





leader qualified in the AH-64 was the only effective way to 
train the platoon as an effective combat fighting unit. 
Without this qualified platoon leader there would not be an 
effective leader who fully understood the system and how to 
tactically employ the system. This argument was also 
rejected and the unit was left four AH-64 pilots short. 

Of the eight pilots approved by OTEA and the PM, two 
did not meet the minimum requirements. However, these 
pilots were acceptable because they were only 200 hours 
short of the total time requirement and exceeded the attack 
helicopter hourly requirement. The AH-1S pilots did not 
have to meet the nourly requirements and, thus, were filled 
from the remaining AH-1S pilots assigned to D Co. 

The PM controlled the developmental test pilots who had 
conducted the first series of tests on the AH-64 and its 
related systems. He proposed that the remaining pilots 
come from this agency. TRADOC accepted this proposal; the 
remaining pilots would come from the Developmental Test and 
teearnine Detachment (DITD). The final crew selection was 
approved 1 November 1980. D Company would provide eight 
Pilots for the AH-64 and ten pilots for the AH-1S, and DTTD 
would provide four pilots for the AH-64 and two pilots for 


the AH-1S. 
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Pe eNALYOLOSOr TEST AVIATORS RELATIONSHIP TO THE 
AVIATION NORM 

The question of whether the AH-64 and AH-1S aircrew 
members in the Advanced Attack Helicopter Test were typical 
of Army attack helicopter aircrew members with respect to 
flight hours was investigated. AH-1S aircrew members were 
typical of Army attack helicopter aircrew members while 
AH-64 aircrew members were considerably more experienced, 
and closely resembled instructor pilots and standardization 
maseructor pilots. 

This analysis was intended to answer the following 
question: Mit yolcdl, OR satypical, of Army attack 
helicopter pilots were the aircrew members who participated 
as crew members in the AH-64 and AH-1S in the Advanced 
Attack Helicopter Test? Since the point of the analysis 
Was typicality, with respect to capability as attack heli- 
copter pilots and copilot gunners, measures of experience 
in flying and fighting helicopters were considered 
appropriate. 

Accordingly, data was gathered on the twelve AH-64 and 
twelve AH-1S aircrew members who participated in the 
Advanced Attack Helicopter Test, using the following 


measures. 
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Total Rotary Wing Flight Hours 

Total Combat Rotary Wing Flight Hours 

loGal = kotary Wing Instructor Pilot Hours 

Total Flight Hours in AH-1 Series Helicopter 
Total Rotary Wing Flight Hours and Total Combat Rotary Wing 
Flight Hours were available from a sample of 222 AH-1 
qualified aircrew members, gathered in 1978 from attack 
femmes rcer units at Fort “Ord, Fort Bliss, Fort Hood, and 
Pore Bragg. Data on all the variables listed above were 
obtained from Flight Standardization Division, Directorate 
of Evaluation and Standardization, US Army Aviation Center, 
Fort Rucker. Additionally, Fort Rucker provided data on 
all the above variables for 292 instructor pilots in attack 
melicoepters. TLS Ws virtually the total population of 
ait series instructor pilots in the Army. Comparisons of 
the flight hour variables were then made among these four 
feeupon Utilizing non=parametric statistical tests since 
the distributions were far from normal. 

Median and mean values of the flight hour variables for 
each of the four groups are presented in Appendix A, Table 
1. From this table it can be seen that (based on median 
values) the AH-1S aircrew members have the fewest hours of 
Aeiienc Nneur variables, followed in order by the 222 
AH-1 qualified aircrew members (1978), the 292 instructor 


pilots (1981), and the AH-64 aircrew members. Further, 1t 


iD 





may be noted that the AH-15 aircrew members are similar to 
the 222 AH-1 qualified aircrew members (1978), while the 
AH-64 aircrew members are similar to the 292 instructor 
pirors. (196%). 

The results of the non-parametric statistical tests of 
the difference among the groups of aircrew members are 
shown in Appendix A. All of these statistical tests were 
Mann-Whitney two tailed tests, with the exception of those 
comparing the 222 AH=-1 qualified aircrew members with the 
292 instructor pilots, which were two-sample Kolmogorov- 
Smirnov two tailed tests. Since none of the statistical 
tests of differences among the groups of aircrew members 
Were significant for total flight hours in the AH-1 series 
helicopters, these tests are not shown. The results of the 
Statistical tests support the conclusion that the AH-64 
aircrew members in the Advanced Attack Helicopter Test were 
essentially similar to the AH-1 series instructor pilots in 
Army attack helicopter units, while the AH-1S aircrew 
members were essentially similar to Army attack helicopter 
aircrew members. This support was clearcut in the cases of 
fotameenotary) Wink) Hours and Total Rotary Wing Instructor 
Pilot Flight Hours, and suggestive, but less clear cut in 


the case of Total Combat Rotary Wing Hours. 
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IV. EVALUATION OF AIRCREWS AND RESEARCH METHOD 


This section will present an analysis of AH-64 crew 
performances observed during July 1981 through August 1981. 
The analysis is based on validated AH-64 engagement data 
provided by OTEA. The analysis considered only Force-on- 
Horcemeaaded from trials Which were determined to be 
representative (the data reflected what actually took place 
and the battle was not shaped by any outside influences. 
No major anomalies occurred which caused the battle to be 
improperly shaped) or marginally representative (the data 
reflected what actually took place, however, an anomally 
existed which may have caused the battle to be improperly 
influenced) by the testing agency. The data was parti- 
tioned into two groups according to whether it occurred 
@emonme or “after the instrumented training day on 30 July 
Le oul a The reason for this division was due to the 
mvcomemsteémcies and deviations in tactical standing 
operating procedures (TSOP) by the test players prior to 
the instrumented training day. Trials conducted after 30 
July 1981 were felt to be much more representative of 
attack helicopter tactical operations. Prior to this date 
crew coordination was adequate but team coordination, (the 


integration of multiple crews), was poor. This came be 
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attributed to the lack of leadership within the AH-64 
platoon. As noted earlier, OTEA had scrapped the idea of 
qualifying a platoon leader in the AH-64 because the 
individual did not meet the minimum flight hour require- 
ment. In my opinion the problems with discontinuity and 
poor early performance are directly related to the absence 
of the qualified platoon leader. 

Experience of the AH-64 crew members in the early 
trials was a deterrent instead of an advantage. Each crew 
felt they had the correct employment method and instead of 
working together they performed operations as individual 
crews fighting the battle instead of performing as a 
member of a larger team. This was not the case in later 
trials; crew performance increased proportionately, nor was 
this the case in the AH-1S base line platoon. The crew 
members in the base line platoon worked exceptionally well 
eomether and in the trials prior to 30 July 1981 they 
continually outperformed the AH-64 crew members. Unfor- 
eunavedy, time constraints precluded sufficient testing of 
the base line platoon crew members so test data on their 
performance level is based on exploratory trials and 
subjectivity. Because of the lack of adequate test data on 
the AH-1S base line platoon only the crew members of the 
AH-64 platoon will be evaluated. A point of interest would 


have been the analysis of the less experienced AH-15 
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platoon and the AH-64 platoon to determine the performance 


ratio. This point should be considered in future tests. 


A. MEASURE OF PERFORMANCE AND EFFECTIVENESS OF THE AH-64 
AIRCREWS 


The measure of effectiveness used in the analysis of 
crew performance was selected to reflect the crew's ability 
rome "pu steel on target. Each autonomous”) simulated 
Hellfire launch was reviewed by the testing agency and an 
outcome was determined to be either an assessment against 
the target or amiss. The following ratio was used to show 


the success of the crew. 


Crew Performance : number of Autonomous Missile Assessments 
Success Ratio Total number of Autonomous Missile Launches 
Two separate analyses were conducted to establish the 
multidimensional contingency table analysis used to analyze 
the missile launch success ratio. The first was conducted 
to investigate any possible differences between those 
trials which occurred before 30 July 1981 and those that 
occurred after that date, the two valleys, and the two crew 
types (those crews from DTTD and those from D. Co. 7th 
CAB). This analysis utilized only those trials which 
Secianed sauring the day. The second analysis examined 


differences between valleys and crews for the night trials. 
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In both of the analyses the six aircrews were categorized 
nee eaers DIED (2)50r D Go. 7th CAB (4) aircrews. 

Included in the assessment total are those assessments 
made as a result of post trial review. Credit was given 
for an assessment during post trial if the onboard AH-64 
video showed the correct conditions and sight picture for a 
Successful engagement. Targets which continued to move 
after being assessed as "dead" in the real time casualty 
assessment (RTCA) process were also analyzed in post trial 
Homme metuslon into the success count. TaeGer Cap le mibeLow 


shows the increase in assessments as a result of post trial 


review. 
Table 4-1 
HMMS Launch Assessments 
Total Real Time ROS ur tal 
Launches Assessments Assessments 

Baeiy Trials ifs ou ie 
Eaver Irials 96 38 31 
Night Trials 91 27 46 


The proportion of crew successes in later trials ss 
Sueamurteantiy higher than the proportion of successes in 


Saieuy trials. 
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Table 4-2 


HMMS Launch Assessments 


Successes Failures 
Eeiehy Irials 35 40 
Later Trials 69 aa 


The data in the above table was summarized by combining 
successes and failures of all crews in each trial category. 
The reasons for the increase were directly attributed to 
changes made by the test players in response to leadership 
changes. The crews responded to their poor early perfor- 
Mance by changing the engagement methods from. singular 
crews to a team effort. ies kaver triats pertray a runit 
Which conforms to a more realistic attack helicopter 
environment. 

The proportion of DTTD crew successes in later trials 
and night trials was significantly higher than the D Co. 


crew successes in those same trials. 


Table 4-3 


HMMS Launch Success/Failure for Unit 


Later (Day) Night 
successes Failures Successes Failures 
DTTD 45 rf Sig 2 
BECO... 24 20 36 12 


aul 





Again, the data in the above table was summarized by 
combining successes and failures for each crew's parent 
Organization in each trial category. A probable explana- 
Eeeneior the differences lies with the DTITD copilot gunners 
S77") GaChwhavVimg 110 hours of TADS tame wersus the D Co. 
crews each having only 30 hours of experience with the 
ADS . Appendix D Figure 1 shows a graph depicting the 
relationship detween performance and hours. Other reasons 
May De related to experience, combat time, Pilot Night 
Vision System (PNVS) time, and Time in Service (TIS). 
Initially, however, the performance between crews (DTTD and 
Peon em the early trials was less dramatic. This can be 
qermemeed directly to D Co.'s familiarity with the terrain 
and the tactical training they had undergone versus DTTD's 
Seeritlé administrative flying and lack of current tactical 
teat niwe . 


-ee SU CS oT WUlGidimensional Contingency Table 


== ee cee eee cee eee eee = == mee ae oe ae 


The results of the analysis are presented in 
Mopendax 8, Table 1. Inspection of tne results indicates 
Semeral Sbenificant differences amomg factors. First 1s a 
@ittferience between trials. As indicated in Appendix 8, 
Table 2 the percent of successful launches is higher (72% 
Ws. etiaoe tor those trials which occurred after 30 July 1931 
Siem staose trials @¥aich occurred prior to that date. The 


difference between valleys can be observed in Appendix 8, 


Ze 
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Table 3. There is a significantly higher percent of 
Successful engagements in the Gabilan Valley than in the 
Nacimiento Valley (68% vs. 47%). The significant differ- 
ence between the crews is presented in Appendix B, Table 4. 
DTTD crews had a success rate of 84% compared to the 46% 
achieved by D Co. crews. Of particular interest are the 
mvoe stem liicant interactions. The valley and crew 
interaction presented in Appendix B, Table 5, and Figure 1. 
It is evident that DTTD crews exhibited more of a differ- 
ence between valleys (92% Gabilan vs. 50% Nacimiento) than 
did D Co. crews (47% Gabilan vs. 46% Nacimiento). An 
Swpiamaction for this difference is that the Gabilan 
provided better fields of fire than did the Nacimiento and 
that the DTITD crews had greater familiarity with the TADS. 
Trial vs. Valley vs. Crew interaction is presented in 
Appendix B, Table 6 and Figure 2. There is a larger 
indicated difference between trials for DTTD crews in the 
Nacimiento (20%, 30 July 1981 and before, vs. 48% after 
that date) and D Co. crews in the Gabilan valley (38%, 30 
July 1981 and before, vs. 63% after that date) than found 
amongst DITD crews in the Gabilan valley (100%, 30 July 
1981 and before, vs. 91% after that date) and D Co. crews 
in the Nacimiento (43%, 30 July 1981 and before, vs. 48% 
after that date). Again, this difference can be directly 


attributed to DTTD's experience with the TADS and lack of 


es 
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Current tactical training. As noted earlier, DTTD crews 
did not work well during the early trials because of their 
inability to work as team members. This short-coming was 
overcome in later trials and their performance level 
increased accordingly. Whereas D Co. crews had worked as a 
unit for some time and thus were used to working together 
mimcaeciecal situations. 
2. Results of Multidimensional Contingency Table 

Merges cftriai, Valley and crew (Nightctr tals) 

The results of the analysis are presented in 
Appendix C, Table 1. inspection Of Une results indicates 
several significant differences among factors. ihe--fLirse 
is a difference between valleys, as indicated in Appendix 
C, Table 3. The percent of successful launches is higher 
(91% vs. 69%) in the Nacimiento valley than in the Gabilan 
valley. Also present is a valley versus crew interaction. 
This is presented in Appendix C, Table 2, and Figure 1. It 
is evident that the D Co. crews exhibited more of a differ- 
ence between valleys (56%, Gabilan vs. 96%, Nacimiento) 
than did the DTTD crews (100%, Gabilan vs. 884%, 
Nacimiento). Again, the reason for the greater success of 
the DTTD crews can be directly related to their experience 


with the TADS and the AH-64. 
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B. ANALYSIS OF AUTONOMOUS HELLFIRE MISSILE SYSTEM 

This analysis determined the relationship between 
the percent of successful simulated autonomous HMMS 
launches for each of six aircrews and various flight crew 
parameters. The number of successful simulated autonomous 
HMMS launches were calculated for each of the six aircrews 
(2 of the crews are DTTD and 4 are D Co.). Only those 
trials which occurred after 30 July 1981 were used in this 
calculation. From these tabulations a "percent of simu- 
lated autonomous HMMS launches which were successful" ratio 
was obtained for each crew. This ratio was then correlated 
uSing simple linear regression with various flight crew 
parameters; (for both the pilot and copilot gunner), total 
flight time, total flight time in attack helicopters (AH-1 
series), total flight time in the AH-64, total combat 
memiieemtame., total instructor pilot (IP) or standardization 
instructor pilot (SIP) flight time, and average test scores 
mm growmd school. Each parameter was correlated with 
successful autonomous HMMS launches to determine if there 
are measures which best describe the characteristics 
required to perform pilot or copilot gunner duties in the 
AH=-64. Those analyses which yielded relevent results are 


discussed in Chapter 5 and in Appendix D. 
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V. ANALYSIS OF CREW PERFORMANCE 


Mes ssection Will draw on the performance levels of 
each aircrew and the relationship of their experience with 
their performance to determine any significant correlation 
between crew performance and individual data. The table 
below shows the combined results of the data used in 
evaluating crew performance, this data iS compiled in 


Appendix B. 


Table 5-1 


Crew HMMS Launch Success Ratio 


Crew success Ratio Performance Peak 
1 377-41 wes ) 1 
2 AOA Caet) 2 
5 USI SIS CG Sy, 5 
4 nov a4 (.71) 3 
20/29 (.69) 4 


Ov UI 


LWA CA sh). ) 


The proportion of crew successes in the Gabilan valley 
during the later trials was significantly higher than the 


proportion of crew successes in the Nacimiento valley. 
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Table 5-2 


Crew HMMS Launches for Valley 





Later (Day) Night 
Successes Failures Successes Failures 
Gabilan St 11 2D 10 
Nacimiento 18 16 43 12 


The table above shows the combined successes and failures 
for all crews for a particular valley. There was not a 
Significant difference in crew successes between valleys 
during the night trials. A possible explanation for tnis 


difference might be explained by the tables below. 


Table 5-3 


yo e HMMS Launch 


Later Trials 


Total sWey ech 
Autonomous Remote 
Launches Launches 
Gabilan 62 LS 
Nacimiento 34 49 


ei 








Table 5-4 


Autonomous HMMS Launch by Crew 


Later Trials 


total Drv jkeircule 10 em 
Autonomous Autonomous 
Launches Launches 
Gabilan 43 19 
Nacimiento 9 25 


The major differences can be explained by the valley's 
physical disposition; the Nacimiento is heavily wooded, 
whereas the Gabilan is open rolling terrain. The 
Nacimiento lends itself to remote shots and the Gabilan to 
autonomous shots. 

There was a significant difference in the types of 
launches between the two valleys. This was possibly due 
to the Gabilan valley offering good autonomous flanking 
shots along the entire western edge of the valley, whereas 
the Nacimiento valley was more conducive to air and ground 
remote launches. Additionally, the proportion of DITD 
launches was significantly higher in Gabilan valley versus 
the Nacimiento valley. With the DTTD crews firing a very 
high success ratio this might affect the results in the 
Nacimiento since the DTTD autonomous opportunities in that 
valley were significantly less. Further analysis of DTTD 


launches reinforced the explanation of the Gabilan valley 
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being used more for autonomous shots and the Nacimiento 
valley for remote shots. The table below shows the DTTD 


breakout. 


Table 5-5 


DTTD Later Trials 


Autonomous Remote 
Launches Launches 
Gabilan 43 1 
Nacimiento 9 25 


The use of remote launches by DTTD can be directly 
attributed to the copilot-gunner. The two DTTD copilot- 
gunners were the Army's test pilots during Developmental 
hes tang. They worked exclusively with the AH-64 and its 
related systems for a year prior to the test. Their 
familiarity with the system provided a distinct advantage 


to their employment concepts and success ratio. 


A. COPILOT GUNNER ANALYSIS OF MOE 

Since there was no significant difference between the. 
Tater trials and the night trials, based upon the MOE used, 
only the copilot gunner characteristic data will be con- 
Sidered for association with the MOE. The copilot gunner 
has probably 95% control over whether a launch will be 
successful. Even though the pilot has a demanding workload 


Pictiemiye ac niente, once a firing position has been 


eo 





occupied, the launch cycle rests with the copilot gunner. 
Therefore, the correlations developed in this section focus 
entirely on the copilot gunners. A non-parametric test was 
chosen to measure the degree of association between the 
performance ranks of the crew with various copilot gunner 
data such aS experience, education, and training scores. 
The Spearman rank correlation coefficient =) was used to 
measure this degree of association. It can vary from +1.0 
Poem 1.0, With numbers cloSe to +1.0 indicating a strong 
positive association and numbers close to -1.0 a strong 
negative association. Numbers close to O indicate no 
dissociation. In addition, a test of the significance of 
the Spearman correlation coefficient was made for each 
conclusion using a = .10. Even though the sample size of 6 
is small, this non-parametric test is designed for such 
Samples. Appendix D provides a detailed correlation 
analysis of all parameters. 

Crew performance and copilot gunner time in service are 
Significantly associated with a correlation coefficient 


i = Cons 
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Table 5-6 
CPG Time in Service (TIS) 


Crew 
Crew Performance Rank CPG ITS (months) CPG TIS Rank 


1 1 IS 2 

2 2 185 1 

3 > 48 

4 3 108 4 
4 147 3 
6 42 6 


The data suggests a fairly strong positive association 


between the performance MOE and the time in service of the 


orc. The TIS rank, also, significantly correlates with 
o. = 1.0 or a perfect positive correlation, with CPG months 
om {lying status. This would tend to suggest that more 


experienced aviators perform better as copilot gunners than 
less experienced, which is a very common sense type result. 
dowever, it must be noted that the experience of the DTTD 
copilot gunners will bias the outcome of the test results 
and a more interesting analysis would be to evalute the 
performance of the D Co. crews separately. 

Another result related to the experience factor is the 
association between performance and the number of months a 
CPG has been assigned to an attack helicopter unit. As 


expected, there exists a significant positive correlation 
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of .828 between the performance data and the number of 
months a copilot-gunner has been asSigned to an attack 
helicopter unit. This would be as expected since longer 
TIS aviators will probably have more opportunities for time 
in attack helicopter units than low TIS aviators. The 
following table shows the rank of CPG's in relationship to 


total time assigned to attack helicopter units. 


Table 5-7 


CPG Months Assigned AH Units 


CPG Months 
CPG Months Assigned to AH 

Crew Crew Performance Assigned to AH Rank 
1 1 130 2 

e 2 is 1 

3 5 26 6 

3 96 4 

5 + 140 3 

6 6 23 5 


Crew performance and the amount of CPG flight hours during 


the last 12 months are not associated. us = -,028) 


g2 








Table 5-8 


CPGr hota Plight Hours Last 12 Months 


Crew Crew Performance Creer iy Aris FLT Hrs Rank 
1 1 95 5 
2 2 126 3 
2 3.0 2 
s ats 4 
5 4 158 1 
6 6 45 6 


Ties as@isleading result; the DITD copilot gunners were 
involved in the AH-64 developmental testing during the 
Preceding it2 months. Their entire flight experience for 
that time was in the AH-64; whereas, the D Co. copilot 
gunners were flying the AH-1S. Crew performance and CPG 
point target weapon system (PTWS) exam results are 


Significantly correlated with r. = 2955. 


Table 5-9 
CPG PTWS Exam Average 


Crew CPG CPG 
Crew Performance Rank PTWS Exam Avg PTWS Exam Rank 
1 ] 100 1 
2 2 98.5 eas 
3 5 Fi25 5 
4 3 Jams 2.5 
5 4 94.8 4 
6 89.8 6 
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An almost perfect positive correlation exists among 
this data. The PTWS exam average was computed from the 
results of the contractor training program examinations 3 
and 4 which dealt exclusively with the Target Acquisition 
and Detection System (TADS), switchology, symbology, and 
the Integrated Helmet and Display Sight system (IHADSS) 
which are crucial to the operation of the Hellfire system. 
It should be noted that the copilot-gunners in Crews 1 and 
2 had received extensive training and experience previously 
during developmental testing of the helicopter. Crew 
performance and copilot gunner civilian education are not 
significantly correlated. Cre Seno |) 

Table 5-10 


CPG Civilian Education 


Crew CPG CPG 
Crew Performance Rank Give Ed Cyr's) Ed Rank 
1 1 14 a5 
2 2 14 Se. 
5 is 5 
5 18 1 
5 4 16 2 
6 6 12 6 
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Although the correlation coefficient showed a pootulye 
correlation, it was not significant for the size of the 
Sample. However, the significance test was very close to 
a = .1 and consideration should be given to this factor if 
a larger sample can be obtained. Crew performance and 
copllot gunner terrain flight hours are not significantly 


ocrrelated. ee = .542) 


Table 5-11 


Ceo loval lerrain Flight Hours 


Crew CPG CEG 
Crew Performance Rank Teprainet lt “Ars Terrain Hrs Rank 
1 1 600 4 
2 2 1700 1 
3 5 700 2 
4 3 1200 2 
5 ~ 500 D 
6 6 450 6 


This result is much like the previous one in which the 
coefficient is positive and the significance level was 
Clgses tow .1, but not in the rejection region. However, 
consideration probably should be given to this factor since 


it is related to TIS and experience level. 
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VI. CONCLUSIONS 


The six crews which constituted the AH-64 test base do 
not mirror the typical Army aviator. The two DTTD crews 
(crew 1 and 2) have been involved with the AH-64 and its 
related systems from the beginning of the program. These 
crews are highly experienced aviators whose performance 
should, by design, be better than the average Army crew. 
In fact, each DTTD crew member is an Instructor Pilot or 
Standardization Instructor Pilot with an average total 
flight time of 4100 hours and an average total AH-1 series 
flight time of 2500 hours. As noted in Appendix A, Table 1 
these hours far exceed the AH-1 Qualified pilots and the 
AH-1 Instructor Pilot community. 

Discounting the DTTD crews, the D Co. crews provide a 
much more interesting analysis from which to choose crew 
members for the AH-64 helicopter. Their average total 
flight time is 1982 hours and their average total AH-1 
flight time is 686 hours which places them between the AH-1 
qualified community and the Instructor Pilot community. 
Demecoemcapilot gunners average total flight time is 347 
hours and their average total AH-1S flight time is 680 
hours. The copilot gunner hours are less than that of the 


Army AH=1 qualified community. 
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Crews 4 and 5 consisted of a maintenance officer, a 
Piet yesOrtutecer;, an instructor pilot and an operational 
pilot. This is a strange mix for crews but does bring into 
light an interesting analogy. These aviators do not mirror 
the tactical and flying experience of the average Army 
attack helicopter pilot. In a typical attack helicopter 
unit, the maintenance officer and safety officer seldom fly 
Mipecacklecal training situations. They are more apt to 
perform administrative missions which correspond to their 
duty positions. These pilots were the copilot gunners for 
crews 4 and 5, whose performance ranks were 3 and 4 
respectively. 

mews CoOnsisted of an instructor pilot in the back 
seat and a 700 hour pilot as the copilot gunner. With the 
experience of the back seater and the lack of experience of 
the copilot gunner they were able to move to their firing 
positions without being detected but had difficulty in the 
engagement sequence. Crews Komprooabmy. the mostutypical 
crew in the test and they achieved a 54% success ratio 
being ranked 5. 

Crew 6 consisted of a 3000 hour back seater who had 
less than 500 hours AH-1 attack helicopter time and in fact 
had spent the majority of his career flying CH-47 heavy 
lift helicopters. The copilot gunner was the lowest time 


aviator with less than 600 hours total time. With the lack 
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eeeomperrence of both pilots their performance rank was 6 
Wieemeea SUCCESS ratio of 31%. 

What is important from this brief description of the 
D Co. pilot history of the crews is, no matter what their 
prior experience level was, they were able to perform 
Veeniee tne design “constraints of the system. They 
performed to the level expected commensurate with their 
experience. Since D Co. crews provide a much better 
picture of Army aviation and aviators, and their perfor- 
mance 1S within the design constraints, the selection of 
pilots to fly the AH-64 does not have to be tied to a 
magical number of time in service, total flight time, or 
total attack helicopter time. Rather to the individual's 
ability to perform within an attack helicopter unit. fhe 
necessary ingredients to successfully operate the AH-64 is 
the ability to think of the machine as an extension of the 
aviator. It is true, as the test proved, the greater the 
experience and exposure to the system the better the 
performance level. However, the Army does not have the 
luxury of having a multitude of DTTD experienced aviators; 
hence, our choice must be made from the population on hand. 
As indicated, D Co. crews are typical of that population 
and thus provide a basis for the selection process. 

With this in mind we can conclude that aircrew members 


should be AH-1 qualified pilots who have performed well in 
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meraekK nelicopter units. %Inis will provide a basis for the 
tactical employment experience necessary to effectively 
employ the AH-64. It is also apparent that the copilot 
gunner should be the more experienced crew member; whicn 1S 
maecimect contradiction to the current manning process of 


attack helicopter crews. 


Bie, 





APPENDIX A 


AVIATOR COMPARISON TABLES 


Table 1 
Total Hel Total Combat 
Pleaars Hel Fit Hrs 
Med Means Med Means 
AH-1S crew 1O50 Liss ---- 342 
N=12 
AH=-1 Qual 1427 1452 ---- HQQ 
Aircrew's 
i978, N=222 
AH=1 IP/SIP 2614 2662 497 5 (os 
1981, N=292 
AH-64 aircrew 2854 Bae 642 6:15 
N=12 
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AH-1S Crew 
N=12 

AH=-1 Qual 
Aircrews 
love, N=222 
AH=1 IP/SIP 
Noem, N=292 


AH-64 Aircrew 
Nz=1i2 


Table 1 


Total IP 
Hel Flt Urs 
Med Means 
22 301 
Suit if 769 
oo 7 983 


- Continued 


4 


Tovalesn eens 


AH=-1 Hel 
Med Means 
450 998 
1010 1114 
Wis 1580 





Table 2 


Total Flight Hours Comparison 


Total Rotary Wing Flight Hours 


AH-15 AH=1-Qual Ne ely 
Aircrew Aircrew 1981 
AH-1S Aircrew  —=§ ----- 
AH=-1-Qual Aircrew N.S. —_ seeee 
ime ss SLPS %% RRR eee 
AH-64 Aircrew * HR Nicos 
Meow) Mot significant, p > .05 
% Sueur icant , Onno <2. OS 
alial Signs. Cane , NOOl << oe 20) 
=e Significant, oma 8101 
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AH-64 


Aircrew 





Fe oe 


Table 3 


Total Combat Flight Hours Comparison 


AH=-18 AH~-1-Qual Sa 
Aircrew Aircrew 1981 
AH-1S Aircrew  — ----= 
AH-1-Qual Aircrew N.S. 2 2 wee 
Haeso& SIP*s, 19381 % CS 
AH-64 Aircrew Nao. Nee Nee 
eS. SHOtesiamificant, De o> 
* Sugnificant , OL. < Me GaO> 
*% Samir reant , OCT < Dp <a 
7=% Susmiricant., Ones OO 


ne 


AH-64 


Aircrew 





Table 4 


hocal noObary Wins Instructor Pilot Flight Hours 


AH-15S ioe tamol P's AH-64 
Aircrew 1981 Aircrew 
AH-1S Aircrew —) ---<== 
Desecr ole 's, 1981 %%% a 
AH-64 Aircrew # Nee 2) ee Hee 
NeoeetloG significant, cme OLS: 
% significant, nO p<. 2.05 
a% Sean Leant , OCHS po <5. 04 
REE Significant, a) Se O10) 
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APPENDIX B 


MULTIDIMENSIONAL CONTINGENCY TABLE ANALYSIS (DAY TRIALS) 


Taple: 1 


Simulated HMMS Autonomous Launches (day trial) 


Information MDL Sana.) df (e) iP avrar a, Cb) 
Base Hypothesis 45.663 Hl . 0000 
imeial 11.272 1 BIN | .0008 
Goodness-of-fit Co esol! 6 Ou.71 .0008 
Valley 8. 446 1 1325 1 mOU sa 
Goodness-of-fit ep 21} 5 43.32 
Crew ese | 1 29.29 0003 
Goodness-of-fit 25 HOY 4 Teo 
Trial vs Valley .294 1 .64 5874 
Goodness-of-fit 22206 3 Hee 25 
iimaab vs Valley Ono 1 Ole ~9194 
Goodness-of-fit 12. 196 2 N3oeet 
Valley vs Crew 6.962 1 in le ole’ s 
Goodness-of-fit 5.234 1 ee) oust 
Trial/Crew/Valley 5.229 T 11.46 "O22e 
Goodness-of-fit .005 0 99.99 


(a) The MDIS is the minimum Discrimination information 
Statistic which is distributed asymptotically as a chi- 
square statistic. 

(b) «a is the critical level of the test, the level at which 


the null hypothesis may be rejected. 
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The hypothesis may be stated: iaemaata 1S Sunmtorm! y 
distributed. 

The goodness-of-fit term describes how well the model 
predicts the values in the table. 

DF indicated the degrees of freedom used in evaluating 
the MDIS statistic. 

The data compiled in this table consists of all valid 
successful simulated autonomous HMMS launches for day 


ealals. 
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Table 2 


Data for Table 1 presented in both numerical count and 
percent of total calculated across trial. 


Trial 30 July 1981 and Before After 30 July 1981 
number percent number percent 
Suieée¢ess 47 47 69 ee 
Failure 40 55 2 28 
Total 74 100 96 100 
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Table 3 


Data for Table 1 presented in both numerical count and 
percent of total calculated across valley 


Valley Gabilan Nacimiento 
number percent number percent 
Success 76 68 28 47 
Failure 3D Be 32 D3 
Total A 100 60 100 
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Table 4 


Data for Table 1 presented in both numerical count and 
percent of total calculated across crew 


Crew DT TD DCO. 

number percent number percent 
Success 56 84 48 46 
Failure 11 16 56 54 
Total 67 100 104 100 
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Table 5 


Data for Table 1 presented in both numerical count and 
percent of total, broken down by Valley and Crew 


Valley Gabilan 
Crew DTTD D Ca, 
number percent number percent 
Success 4g 92 27 7 
Failure u 8 31 DS 
Total a fe: 100 58 100 
Valley Nacimienta 
Crew number percent number percent 
Success 7 50 21 46 
Failure 7 50 25 54 
Total 14 100 46 100 
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Table 6 


Data for Table 1 presented in both numerical count 
percent of total broken down by Trial, Valley, and Crew 


trea 1 30 July 1981 and Before 

Valley Gabilan 

Crew Diep DY Serr 
number b number y 

Success 10 100 Vs 38 

Failure 0 ©) 24 62 

Total 10 100 39 100 

Valley Nacimiento 

Success 1 20 9 43 

Failure - 80 12 Bi 

eta 1 5 100 21 100 


Meine sl ook, Sei] 


Valley Gabilan 

Success 39 91 12 63 
Failure 4 3 i Sh 
Total 43 100 19 100 
Valley Nacimiento 

Success 6 67 12 48 
Failure 3 55 iS 52 
Total 9 100 25 100 


5] 
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APPENDIX C 


MULTIDIMENSIONAL CONTINGENCY TABLES (NIGHT TRIALS) 


Table 1 


Multidimensional contingency table analysis of valley by 
crew and successful autonomous HMMS launches for all valid 


bec trials 


marormation Mpls (ia) df (e) % Var a (b) 
Base Hypothesis 17.993 3 00044 
Valley 6.805 1 BCR oe . 0091 
Goodness-of-fit ieieeres 2 BRE 

Crew 1.941 1 10.79 ~ 1635 
Goodness-of-fit 9.248 1 48.61 

Valley vs Crew 9.242 1 51.36 0024 
Goodness-of-fit .006 0 99.97 
Trial/Crew/Valley 5 eeeg 1 11.46 0222 
Goodness-of-fit Os 0 99.99 


(a) 


(b) 


(c) 


(d) 


The MDIS is the minimum Discrimination information 
Statistic which is distributed asymptotically as a 
chi-square statistic. 

a iS the critical level of the test, the level at 
which the null hypothesis may be rejected. 

The hypothesis may be stated: Tne data is uniformly 
distributed. 


The goodness-of-fit term describes how well the model 


predicts the values in the table. 
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(e) DF indicated the degrees of freedom used in evaluating 
the MDIS statistic. 

(f) The data compiled in this table consists of all valid 
successful simulated autonomous HMMS launches for 


Heme trials. 
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Table 2 


Data for Table 1 presented in numerical count and percent 
me tOtal, broken down as Trial by Valley and Crew 


Valley Gabilan 
Crew DTTD Deca 
number percent number percent 
Success 17 100 14 56 
Failure 0 0 11 dy 
Total 11 100 25 100 
Valley Nacimiento 
Crew UID, Deon 
number percent number percent 
Success 28 88 22 96 
Failure - 2 1 - 
Total 32 100 De 100 
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Table 3 


\ 


Data for Table 1 presented in numerical count and percent 
of the total, broken down for valley 


Valley Gabilan Nacimiento 
number percent number percent 
Success 25 69 50 a 
Failure 11 31 > 9 
Total 36 100 aS, 100 


57 





Taoles 4 


Data for Table 1 presented in numerical count and percent 
of the total, broken down by crew 


Crew DTTD D Co. 

number percent number percent 
Success 39 91 36 ie, 
Failure a 9 12 25 
Total 43 100 48 100 
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APPENDIX D 


CORRELATION TABLES 


Figure 1 
A 
° DI TD 
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Figure 5 
100 


A 
A 
6O 
°/6 " 
4O 
A 


20 7 


SO 7O 9O 110 130 150 


AH-64 


Relationship between total crew flight hours in the 
0 


AH-64 prior to the test and the % of successful 
simulated autonomous HifMS launches 


64 





Figure 6 
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APPENDIX E 


CREW PERFORMANCE DATA SUMMARY 


Crew 
Liaw Ib) (bey 
Weatetah Valley 1 2 3 4 5) 6 
024 N O72 
026 G 175 O71 
on G 4 /y 374 
1Ols: G 6/6 bo 
108 G 4/5 
109 e 4/6 
110 N ee OLAS 
fli N 5/6 ay i 
ale N jl Be 
113 G 2/9 
15 N 4/5 1/2 0/1 
Ie N 2/4 2/4 0/1 
Le N 2/8 779 
118 G 5W/s 2/7 
119 G 5/7 1/1 
120 G 576 4/6 
28) G 14/15 B/D 
126 G 6/9 5/9 
| Zi G I27 t2 BLS 
129 N i373 a7 ve Oakes 
130 N 6/10 8/11 
Legend: 


(1) Data reflects MOE of # Success/# Success + # Failures 

(2) Early trials are 113 and before and later trials are 
averting 1 1.3. 

(3) N denotes Nacimiento valley 

(4) G denotes Gabilan valley 
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APPENDIX F 


Cril=) QUARE OMI EST EXAMPLE 


Hypothesis 


Hy - There is no difference between the proportion of 
crew successes in the early trials versus the 
later trials. 


H, - The proportion of successes in later trials is 
greater than in the early trials. 


Data 
Successes Failures 
Early Trials A B 
33 Ni SONGBee sD: S166 
Mater trials G D 54 
Signficance Level - Let © = .1 


Computations | 


xe " NC {AD = BC] - N/2)° = 4.56 
Bg@wee( C+D) (Asc) (BaD) ~~ 
pee (x* eZ 4.56/H,) SE nOD <1. 05 


Decision 


SEGemEnoo C= = . 1 Reject Ho in favor of H, 


Conclusion 
Therefore the proportion of successes in later trials 
is greater than in the early trials at the .1 level of 


Significance. 
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APPENDIX G 
SPEARMAN RANK CORRELATION COEEFICIENT 


1. Hypothesis 


Ho = Crew performance and copilot gunner time in 
service are not associated. 


H, - Crew performance and copilot gunner time in 
service are associated positively. 


2% Data 
Crew Performance Rank (x) CPG TIS RANK (y) Diff (d) pirré 
1 1 2 1 1 
2 2 1 1 1 
3 5 5 0 0 
r 3 y 1 1 
5 4 3 1 1 
6 6 6 0 0 
3. Significance Level - .1 
3 3 3 
, 2 aN tee to =0 _ : 
4 Computations Rp = na ia = Lier = Tai ae - Q0Q = 17.5 
sy° = 17.5 
Spearman Rank 2 Fi 
Correlation Coefficient rs = EeXeeuyigee = .885 
of =X sy? 


Prob Slee > - 885] Hy) je) = BO Qe a Nass 
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Conelusion 


Since Prob < » = .1 we can reject Ho and accept the 
hypothesis that performance and copilot gunner time in 


Service are associated positively. 
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